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1. INTRODUCTION 

The most prominent issue humanity has recently experienced in terms of viral infection is the 
current outbreak of COVID-19, triggered by SARS-CoV-2 (severe acute respiratory syndrome coronavirus 
2). Even as the nation aspired for quick COVID-19 vaccine rollouts in 2021, researchers' expectations may 
be limited by the pandemic. In this epidemic, millions were infected and died [1]. Even with widespread 
immunizations, still, the daily cases keep on resurfacing. The pandemic has resulted in the loss of many jobs. 
It has closed many entertainments, educational, sporting, religious, tourist, and public establishments 
worldwide. Different research approaches are proposed to minimize the economic impact of the pandemic. 
The number of COVID-19 papers is 20 times higher than prior viral diseases [2]. 

Information and communication technology (ICT) is the only option for people to be socially engaged or 
keep their enterprises going in these uncertain times. There are numerous social networks (SNs) through which 
people may stay in touch with their contacts, post photos and videos of their activities, find new acquaintances, or 
even conduct business online. They can enroll in classes, attend religious services, or work remotely using these 
methods. To decrease the consequences of this outbreak and limit the disease's transmission as rapidly as possible, 
governments in many countries have developed several digital technologies as a solution, like intelligent device 


Journal homepage: http://beei.org 


588 m) ISSN: 2302-9285 


apps, internet-based frameworks, and unified platforms like contact tracing apps. These digital systems gather 
massive volumes of personal data in many states to achieve many goals (such as locating the disease's covert 
transmission routes, preventing its further spread, and predicting future trends). 

Moreover, authorities have utilized digital solutions to prevent clinical staff from experiencing stress 
and for effective resource planning, considering the incidence of COVID-19 [3]. These data are vital for the 
fight against the outbreak. However, collecting these data can be vulnerable to manipulation or abuse if 
adequate attention to individual privacy is not made amidst the recent spike in digital activity. In a certain way, 
privacy concerns have pushed digital advancements under tremendous pressure [4]. Privacy violations have 
considerably increased because of the widespread using technology to fight COVID-19. As a result, there is an 
inescapable necessity to shift focus away from data-first and toward privacy-first [5]. Privacy considerations 
make it difficult for many governments worldwide to get consumers to use pandemic-related apps [6]. 

Since many countries embrace big data and AI, group privacy breaches are more likely than 
individual ones in this global epidemic. There was an event in South Korea in which the spread of 
COVID-19 was traced to a lesser-known religious sect (the Shincheonji church) [7]. Consequently, the 
government had access to a vast amount of raw data, such as transactions, credit card use, mobile id, social 
security numbers, and going to pharmacies that members made of the Shincheonji church. Because of these 
invasions of privacy and the involvement in their personal life brought about by the harsh actions taken 
against them by the government of South Korea, several members have taken their own lives. The 
equilibrium between public security and personal privacy is significantly supported via the law in countries 
like Singapore, but this can contribute to many adverse effects during the era of post-COVID-19 because of 
the massive information transformation into the digital world [8]. Without legislative tools for COVID-19 
like catastrophes, protecting privacy from corporate and government exploitation is difficult [9]. The volume 
and diversity of personal data acquired have expanded, which may assist corporate/political players in 
demanding more intrusive data for political advertisement. Post-COVID-19, privacy and cybersecurity risks 
will undoubtedly increase along with digitization [10]. 

Recently, a significant attempt has been undertaken to solve privacy issues arising from technology 
services linked to COVID-19, together with information collection and analysis, to halt the pandemic. 
Prominent and noteworthy research and technology initiatives like Apple's and Google's contact tracking 
systems, which are decentralized and respect users' privacy [11], Tracing people through their phone calls 
without compromising their privacy [12], and privacy-safe monitoring of possible COVID-19 infections [13], 
personal data privacy protection law [14], consent-based data processing [15], utilization of personal 
information based on user consent [16], and methods of statistical disclosure control [17], 
RDA-recommended data sharing [18], responsible data governance [19], Protocols for protecting personal 
information using blockchain technology [20], clustering without disclosing personal information [21], 
Al-driven software for privacy protection [22], and methods for protecting individual privacy based on 
differences in identifiability [23] are some instances. 

Previous studies related to privacy in the scope of COVID-19 examined a range of essential topics, like 
privacy concerns in technological approaches, privacy-preserving techniques and approaches for medical 
information, privacy specifications amid the electronic surge, private data confidentiality frameworks, ethical 
considerations with ICT used to combat the disease outbreak, balancing privacy, and protecting the public from the 
epidemic, and privacy issues in contact-tracing apps. Sowmiya et al. [24] conducted a survey and found privacy 
and security concerns with contact-tracing apps intended to stop the spread of COVID-19. They also provided 
helpful suggestions for protecting personal data in the cloud. Vadrevu et al. [25] examined various cutting-edge 
techniques for protecting privacy in video surveillance and medical record. Using a set of eight questions, 
Zeinalipour and Claramunt [26] examined the primary post-COVID-19 privacy concerns with contact-tracing 
apps. Their study provides valuable insight into the advantages and disadvantages of contact-tracing apps. 

Schmidtke [27] explored the privacy concerns and limitations of deploying digital solutions utilizing 
location data to contain COVID-19 outbreaks. The author emphasized the necessity of context-specific 
models when tackling privacy concerns in preventing COVID-19-like pandemics. Shuja et al. [28] explored 
COVID-19 open-source data privacy. The authors proposed an information unification to address the 
pandemic and anonymity to protect user privacy. Sihombing et al. [29] examined privacy protection 
measures in 9 countries. Some other scholars have also published assessments of the COVID-19-era privacy 
protection mechanisms specific to each country [30]-[32]. 

In addition, some prior works have centered on the measuring of privacy threats [33], the type of 
digital solution (for instance, centralized or decentralized) [34], public acceptance of digital apps [35], 
privacy concerns of technological advancements in COVID-19 context [36], concerns over aggressive use of 
ICT in the face of a global epidemic [37], and privacy concerns in healthcare during COVID-19 period [38]. 

Privacy and COVID-19 research began in 2020. Scholars have since adopted this term to study the 
development of related technologies. This study uses bibliometrics to analyze scientific publications on 
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health privacy. The bibliometric analysis examines research domain knowledge structure and growth using 
associated publications. These will be significant and valuable findings to help the researchers or scholars 
comprehend the policy changes and related development within the domain. 

This work is organized as follows: in section 2, the method of literature identification, searching, 
filtering process and analysis were discussed. In section 3, results and a discussion of the findings were 
presented. Finally, section 4 summarizes the concluding remarks of this review. 


2. METHOD 

This research obtained all its data from the Scopus database as of July 2022. The Scopus database 
has been used since it is the "biggest single abstract and indexing database ever developed" [39] and also the 
most excellent accessible abstract and citation source for searching publications [40], respectively. Some of 
the statistical summariess have been gathered from the manuscripts that have been collected. These results 
include the following: type of access, year of publication, name of the researcher, subject area, type of 
document, the title of the source, keywords, affiliation, country, type of source, and type of language. 


3. DISCUSSIONS AND RESULT 

The information that was gathered was evaluated to establish the following: type of document, type 
of source, yearly growth, type of languages, subject areas, keywords, individual country productivity, 
authorships, and several citations. The majority of the findings are presented using percentages and frequency 
distributions. For the annual increase, we provided information in the form of yearly documents, along with 
their frequencies, percentages, and percentage distribution, through July 1, 2022. 

This section is determined to explain the finding of the study and provide a thorough analysis. 
Several visual elements (such as tables, graphs, and figures) can be used to illustrate findings and facilitate 
comprehension [14], [15]. The discussion may be broken up into several sub-sections. 


3.1. Document and source type 

First, document types and source types were identified from the data. Sources include journals, 
conference proceedings, book series, books, and trade publications. Conference papers listed as sources were 
distinct from those listed as documents [41]. Conference papers are papers that were first given at conferences but 
were later expanded into full-length journal articles. Even though the document type was originally a conference 
paper, it has since been published in other formats, such as conference proceedings or a book chapter. The 
research revealed six distinct publication forms covering topics related to privacy and COVID-19: journals, 
conference proceedings, book series, trade journals, books, and undefined. Table 1 shows that 58.16% of 
publications appeared in journals, whereas 27.16% were presented in conferences. The other documents are 
around 15%, with each category having some% of the total records. The lowest among them were undefined, 
with less than 1%. Table 2 presents four document types. The article has the highest representation among 
the document type at (51.79%), followed by the conference paper with 33.69%. Book chapters and reviews 
also produce a sizable amount of resources, accounted for 7.34% and 7.18%, respectively. 


Table 1. Source category 


Source category Frequency Percentage (%) 
Journals 713 58.16 
Conference proceeding 333 27.16 
Book series 96 7.83 
Book 72 5.87 
Trade journal 9 0.73 
Undefined 3 0.24 
Total 1226 100.00 


Table 2. Document category 
Document category Frequency __ Percentage (%) 


Article 635 51.79 
Conference paper 413 33.69 
Book chapter 90 7.34 
Review 88 7.18 
Total 1226 100.00 
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3.2. Year of publication 

The first research on privacy and COVID-19 was published in 2020 by Bradford, Aboy, and Liddell 
[42] in their paper titled, “COVID-19 contact tracing apps: a stress test for privacy, the GDPR, and data 
protection regimes”. The number of publications covering this topic has been rising, and this trend is expected 
to continue through 2021. On the other hand, it was significantly raised as shown in Figure 1. From Figure 1, it 
can be observed that publications related to privacy and health issues, in general, have been increasing twice 
their size; this is because of the privacy concerns during lockdown have been an increase. The year 2022 is 
predicted to have the most significant number of publications since the pandemic began. The year 2023 is still a 
ways off, but several articles have already been planned and indexed in the Scopus database. 
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Publication Year 
Figure 1. Summary of publications by year 


3.3. Documents language 

As can be seen from Table 3, nearly all of the retrieved papers were originally published in English 
(99.43%). Only a small fraction of the documents analyzed were written in languages outside English; they 
were Portuguese, Dutch, French, and Italian. 


Table 3. Languages used 
Language Frequency Percentage (%) 


English 1226 99.43 
Portuguese 3 0.24 
Dutch 2 0.16 
French 1 0.08 
Italian 1 0.08 
Total 1233 100.00 


3.4. Subject area 

The research also categorized the published papers by topic. The majority of the research on privacy 
and COVID-19 were in computer science, which represented 29.54% of the total records, followed by 
medicine (19.18%), engineering (12.77%), social sciences (9.77%), and mathematics (4.17%). The other 
subject areas covered privacy, and COVID-19 research is tabulated in Table 4. 


Table 4. Subject area 


Subject area TP Percentage (%) 
Computer science 659 29.54 
Medicine 428 19.18 
Engineering 285 12.77 
Social sciences 218 9.77 
Mathematics 93 4.17 
Decision sciences 89 3.99 
Health professions 82 3.68 
Business, management, and accounting 61 2.73 
Nursing 54 2.42 
Biochemistry, genetics, and molecular biology _ 47 2.11 


Bulletin of Electr Eng & Inf, Vol. 12, No. 1, February 2023: 587-596 


Bulletin of Electr Eng & Inf ISSN: 2302-9285 Oo 591 


3.5. Keyword analysis 

The VOSviewer software [43], a tool for creating and visualizing bibliometric networks, created a 
network between the author keywords and the publications that used them. Figure 2 shows a network 
visualization of the authors' keywords. The relationships between the keywords are illustrated using colour, 
square size, text size, and the thickness of connecting lines. Keywords that share the same hue, for instance, 
appeared to be grouped. Therefore, in this research, privacy, COVID-19, pandemic, digital contact tracing, 
pandemics, and coronavirus infection have the same colour (yellow), indicating a close association between 
the terms and their frequent cooccurrence together. Considering the frequency of occurrences (after data 
cleaning on the author keywords), the keywords such as privacy and human were the most used in the 
privacy and COVID-19 study. The top 20 keywords used in the privacy and COVID-19 research are shown 
in Table 5. 


N VOSviewer 


Figure 2. Keyword maps analysis 


Table 5. Keywords 


Keyword Frequency 
Privacy 594 
Data privacy 383 
Human 333 
Health 241 
Confidentiality 218 
Article 195 
Health care 195 
Electronic health record 154 
Security 136 
Privacy-preserving 132 
COVID-19 117 


3.6. Geographical distribution 

Scholars from 79 various countries published the collected articles. Table 6 shows the top 20 nations 
in the privacy and COVID-19 publications. The U.S published the most documents with 353 publications, 
followed by China (127), India (115), and Canada (96). The United States topped the list for total citations 
with 3026, followed by China (1872). 


3.7. Citation analysis 

Moreover, we utilized Harzing's Publish or Perished application to look for citation metrics 
associated with the retrieved information. This application uses data extracted from the Scopus database to 
analyze the citation score and total citations for each publication based on sources found in Google Scholar. 
Table 7 summarizes the retrieved documents’ citation metrics as Ist July 2022. The summary provides 
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information on the total number of citations produced each year and the number of citations made by each 
author and article. 

The top 20 cited articles in privacy and COVID-19 were listed in Table 8 (in appendix). An article 
entitled “The impact of personal dispositions on information sensitivity, privacy concern and trust in disclosing 
health information online” by Bansal, Zahedi, and Gefen [44] obtained the most significant number of citations 
overall, with a total of 529 citations, according to the Scopus database (44 citations per year) [45], [46]. The 
same paper also acquired the maximum number of citations, with a total of 900 citations and 75 citations each 
year, according to the total citations tracked by Google Scholar as of the 1st of July 2022. 


Table 6. Top 10 countries contributed to privacy and COVID-19 publications 


Country Total publication Total citation 
United States 353 3026 
China 127 1872 
India 115 1300 
Canada 96 651 
United Kingdom 84 1083 
Australia 80 828 
Germany 65 664 
Saudi Arabia 40 349 
South Korea 34 350 
Netherlands 33 313 


Table 7. Metrics 


Reference date 1/7/2022 
Publication years 2010-2022 
Citation years 12(2010-2022) 
Papers 1226 
Citations 15593 
Citations/year 1299.42 
Citations/paper 12.72 
Citations/author 5602.78 
Papers/author 525.66 
Authors/paper 3.36 
h_index 59 
g_index 94 
hc_index 54 
hI_index 13.81 
hI_norm 32 


4. CONCLUSION 

This article provides a bibliometric review to understand better the trends, historical thinking, 
predictions, and contributions found in the privacy and COVID-19 literature. This research examines how 
privacy studies expanded in the last 11 years with more COVID-19 articles. 2020 saw 172 publications, up 
from 104 in 2018. As of June 2022, the total number of privacy and COVID-19 publications was 87. Privacy 
and COVID-19 articles had 3.65 authors on average. This research also illustrates that the scope primarily 
covered in the privacy and COVID-19 study is related to data privacy and humans based on the authors’ 
keywords in their work. Other possible subjects worth investigating include privacy and contact tracing apps, 
the privacy policy of IoT, privacy and blockchain, medical informatics, and privacy-preserving that can be 
conducted as future works. The U.S has the most publications and citations compared to Canada and the UK. 
We advocate conducting privacy and COVID-19 research in developing nations because of the technology’s 
global impact. The study's findings and projections opine that COVID-19 and privacy will serve as the 
impetus for a number of long- and short-term policy changes, necessitating researchers’ theoretical and 
empirical focus. 

Our research is restricted in several ways due to the characteristics of the database that was utilized. 
Even though Scopus is a vast database, there are still unindexed journals whose papers may have been 
disregarded. This study only focused on privacy and COVID-19 based on document titles. Thus, all 
additional privacy and COVID-19-related publications without the title were likewise discarded. There is no 
ideal search query; there is a possibility of obtaining false positive and negative results. Our citation analysis 
used Scopus and Google Scholar data. Total publications and citations are only correct at search time. This 
research is one of the first to delve into the specific bibliometric indicators of privacy and COVID-19. 
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APPENDIX 
Table 8. Top 20 articles in privacy and COVID-19 study 
S/No Paper title Authors Years Journal name cited Cites oe GS% ites 
by per year Cites by per year 
1 The impact of personal G. Bansal, F. 2010 Decision Support 529 44.08 900 75.00 
dispositions on information “Mariam” Zahedi, Systems 
sensitivity, privacy and D. Gefen 
concerns, and trust in 
disclosing health 
information online 
2 Security and privacy in J. L. Fernández- 2013 Journal of 384 32.00 660 55.00 
electronic health records: A Alemán, I C. Biomedical 
systematic literature review Señor, P. Á. O. Informatics 
Lozoya, and A. 
Toval 
3 Ancile: Privacy-preserving G. G. Dagher, J. 2018 Sustainable Cities 329 27.42 495 41.25 
framework for access Mohler, M. and Society 
control and interoperability Milojkovic, and P. 
of electronic health records B. Marella 
using blockchain 
technology 
4 Security and Privacy in Y. Zhang, D. 2018 IEEE Internet of 249 20.75 297 24.75 
Smart Health: Efficient Zheng, and R. H. Things Journal 
Policy-Hiding Attribute- Deng 
Based Access Control 
5 Unaddressed privacy risks K. Huckvale, J.T. 2015 BMC Medicine 227 18.92 390 32.50 
in accredited health and Prieto, M. Tilney, 
wellness apps: A systematic P.-J. Benghozi, 
cross-sectional assessment and J. Car 
6 A review of the state-of-the- A. Abbas and S.U. 2014 IEEE Journal of 226 18.83 336 28.00 
art privacy-preserving Khan Biomedical and 
approaches in the e-Health Health Informatics 
clouds 
7 Towards Secure and A. Zhang and X. 2018 Journal of Medical 219 18.25 334 27.83 
Privacy-Preserving Data Lin Systems 
Sharing in e-Health 
Systems via Consortium 
Blockchain 
8 Availability and quality of A. Sunyaev, T. 2015 Journal of the 194 16.17 350 29.17 
mobile health app privacy Dehling, P. L. American Medical 
policies Taylor, and K. D. Informatics 
Mandl Association 
9 Health information privacy X. Zhang, S. Liu, 2018 Information and 171 14.25 223 18.58 
concerns, antecedents, and X. Chen, L. Wang, Management 
information disclosure B. Gao, and Q. 
intention in online health Zhu 
communities 
10 Patients want granular K. Caine and R. 2013 Journal of the 169 14.08 281 23.42 
privacy control over health Hanania American Medical 
information in electronic Informatics 
medical records Association 
11 Privacy and Security in B. Martinez-Pérez, 2015 Journal of Medical 167 13.92 317 26.42 
Mobile Health Apps: A I. de la Torre-Diez, Systems 
Review and and M. López- 
Recommendations Coronado 
12 A privacy preserving three- Q. Jiang, M. K. 2016 Journal of 159 13.25 193 16.08 
factor authentication Khan, X. Lu, J. Supercomputing 
protocol for e-Health clouds Ma, and D. He 
13 Information Technology- S. Park, G. J. Choi, 2020 JAMA - Journal of 156 13.00 296 24.67 
Based Tracing Strategy in and H. Ko the American 
Response to COVID-19 in Medical Association 
South Korea - Privacy 
Controversies 
14 Is deidentification sufficient M. A. Rothstein 2010 American Journal of 147 12.25 235 19.58 
to protect health privacy in Bioethics 
research? 
15 Privacy-preserving personal H. Qian, J. Li, Y. 2014 International Journal 145 12.08 199 16.58 


health record using multi- 
authority attribute-based 
encryption with revocation 


Zhang, and J. Han 


of Information 
Security 
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Table 8. Top 20 articles in privacy and COVID-19 study (continue) 
S/No Paper title Authors Years Journal name cated Gils GSE Cae es 
by peryear Cites by per year 

16 Views on health G. Perera, A. 2011 International 143 11.92 243 20.25 
information sharing and Holbrook, L. Journal of Medical 
privacy from primary care Thabane, G. Informatics 
practices using electronic Foster, and D. J. 
medical records Willison 

17 Exploring the far side of T. Dehling, D- 2015 JMIR mHealth and 138 11.50 251 20.92 
mobile health: W. Inf, F. Gao, S. uHealth 
Information security and Schneider, and A. 
privacy of mobile health Sunyaev 
apps on ios and android 

18 Publishing data from A. Gkoulalas- 2014 Journal of 135 11.25 215 17.92 
electronic health records Divanis, G. Biomedical 
while preserving privacy: Loukides, and J. Informatics 
A survey of algorithms Sun 

19 Analysis of the security J. JPC Rodrigues, 2013 Journal of Medical 128 10.67 194 16.17 
and privacy requirements I. de la Torre, G. Internet Research 
of cloud-based electronic Fernández, and 
health records systems M. López- 

Coronado 

20 Healthchain: A J. Xu, K. Xue, S. 2019 JEEE Internet of 122 10.17 158 13.17 
Blockchain-Based Privacy Li, H. Tian, J. Things Journal 
Preserving Scheme for Hong, P. Hong, 


Large-Scale Health Data and N. Yu 


*GSc=Google Scholar 
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